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Abstract 

We show that the separabihty of states in quantum mechanics has a close counter- 
part in classical physics, and that conditional mutual information (a.k.a. conditional 
information transmission) is a very useful quantity in the study of both quantum 
and classical separabilities. We also show how to define entanglement of formation 
in terms of conditional mutual information. This paper lays the theoretical founda- 
tions for a sequel paper which will present a computer program that can calculate a 
decomposition of any separable quantum or classical state. 



1 Introduction 



Recently, a few authors||T|0[|| have noticed a deep connection between conditional 
mutual information and quantum separability. In a parallel development, some 
researcher S00] have recently proven theorems giving necessary and sufficient condi- 
tions for quantum separability using ideas that hark back to a paper by Hughston- 
Jozsa-WoottersQ]. An important goal of this paper is to tie together these two ap- 
parently disconnected lines of thought. 

In this paper, we explore the classical roots of quantum entanglement. We 
show that the separability of states in quantum mechanics has a close counterpart in 
classical physics, and that conditional mutual information is a very useful quantity 
in the study of both quantum and classical separabilities. 

In this paper, we also show how to define entanglement of formation in terms 
of conditional mutual information. 

In a sequel paper that will soon follow, we will present a computer program 
based on the theory of this paper. Our software uses a relaxation algorithm to cal- 
culate a decomposition of any separable quantum or classical state. The authors of 
Ref. m have written some excellent software that can calculate similar things using 
an algorithm different from ours. 

2 Notation 

In this section, we will introduce certain notation which is used throughout the paper. 

For any finite set S, let \S\ denote the number of elements in 5*. The Kronecker 
delta function 6{x, y) equals one if x = y and zero otherwise. We will often abbreviate 
S{x,y) by 6y. For any Hilbert space H, dim(H) will stand for the dimension of H. If 
l^p) G H, then we will often represent the projection operator by 7r('0). 

We will underline random variables. For example, we might write P{x = x) 
for the probability that the random variable x assumes value x. P{x = x) will 
often be abbreviated by P{x) when no confusion will arise. will denote the set of 
values which the random variable x may assume, and A''^ will denote the number of 
elements in Sx- With each random variable x, we will associate an orthonormal basis 
{\x) \x G 5"^} which we will call the x basis. We will represent by Ti^ the Hilbert space 
spanned by the x basis. Thus, dimTix = N^- 

For any two random variables x_ and Sx,y will represent the direct product 
set Sx^Sy = {(x, y)\x G Sx, y G Sy}. Furthermore, 'Hx,y will represent Hx^ Ti-y, the 
tensor product of Hilbert spaces TCx and TCy. If |x) for all x is the x basis and \y) for 
all y is the y basis, then Hxy is the vector space spanned by {\x, y)\x G Sx, y G Sy}, 
where |a;, y) = \x) \y). 

For any l-^^) G TCx, we will use ipx to represent (xlipx)- For any \i/jxy) ^ TCxy, 
we will use ipxy to represent (Xjyli/jxy) ■ 
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pd(S'^) will denote the set of all probability distributions P(-) for the random 
variable x; i.e., all functions P : Sx ^ [0,1] such that I]^; -P(a;) = 1. dm(TCx) will 
denote the set of all density matrices acting on the Hilbert space Hx, i-e., the set of 
all Nx dimensional Hermitian matrices with unit trace and non-negative eigenvalues. 

Whenever we use the word "ditto", as in "X (ditto, Y)", we mean that the 
statement is true if X is replaced by Y. For example, if we say "A (ditto, X) is smaller 
than B (ditto, Y)", we mean "A is smaller than B" and "X is smaller than Y". 

This paper will also utilize certain notation associated with classical and quan- 
tum entropy. See Ref. [0] for definitions and examples of the use of such notation. 

3 Classical Separability 

In this section, we will discuss classical separability. In the next section, we will 
discuss quantum separability, stressing the similarities with the classical case. 

We will say P{x, y) G \id{Sxjj) is N -separable iff there exists some random 
variable a with A^^ = and there exist probability distributions P{x\a) G pd(S'i|^), 
P{y\Q) G pd(S'y), P{a) G pd(S'a) such that P{x,y) can be "decomposed" thus: 

P{x,y) = Y.P{x\a)P{y\a)P{a) . (1) 

a 

We will also say that P{x, y) G pd{Sxy) is separable iff it is A^-separable for some A^. 

Theorem 3.1 P{x,y) G pd{Sxy) is N -separable (ditto, separable) if and only if there 
exists P{x,y,a) G pd{Sxya) with = N (ditto, with arbitrary) such that 

P{x,y) = Y.P{x,y,a) (2) 

a 

and 

P{x,y,a)P{a) = P{x,a)P{y,a) (3) 

for all {x,y,a) G Sxya- (The last condition is just another way of expressing condi- 
tional independence: 

P{x,y\a) = P{x\a)P{y\a) . (4) 

; 

proof: 

(^) Since P{x,y) is separable, there exist probability distributions P{x\a), 
P{y\a), P{a). Define P{x,y,a) G pd{Sxya) by P{x,y,a) = P{x\a)P{y\a)P{a) 

P{x,y,a) clearly satisfies all the conditions imposed upon it by the right hand side 
of the theorem. 
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(<^=) The right hand side of the theorem provides us with P{x, y, a) G pd{Sxya)- 

We can use it to construct conditional probabihties P{x\a), P{y\a) and P{a) which 
satisfy Eq.(g). QED 

Suppose f{x,y) is a real valued function of two arguments x,y (i.e., / : S*^ x 
Sy R). Let * stand for either addition or multiplication. If there exist real valued 
functions fi{x) and f2{y) such that f{x,y) = fi{x) * f2{y) for all x,y, then we will 
say that / is an x, y ^corrugated surface. 

Suppose that f{x,y) = * f2{y) is a *corrugated surface such that the 

functions /i, /2 are differentiable. Suppose the z axis points upward, the x axis east- 
ward, and the y axis northward. If we plot f{x,y) along the z direction, then the 
mountain tops and valley bottoms of the / surface are all oriented along either the 
east-west or the north-south directions. Indeed, if at a; = Xq, d^fi^xo) = 0, then 
dxf{xo,y) = for all y; and likewise if dyf2{yo) = 0, then dyf{x,yo) = for all x. 
This is true regardless of whether * stands for multiplication or addition. 

a i a 




(a) (b) 



Figure 1: Two {x,y,a) lattices. Filled circles represent lattice points which have 
non-zero probability. 



Now consider any P{x,y,a) G pd{Sxya)- If P{x,y,a) satisfies Eq.(|^), then 
it is an x, y product-corrugated surface at fixed a. One can convey this concept 
graphically by drawing a 3-dimensional orthogonal lattice with main axes x,y,a, and 
writing at each lattice point {x,y,a) G Sxya the value P{x,y,a). Each a & Sa 

determines a different horizontal plane. The values of P{x, y, a) at each horizontal 
plane are product-corrugated. This geometrical insight immediately suggest that 
all P{x, y) G pd{Sxy) are separable. Two possible decompositions of P{x, y) are as 
follows: 

(a) Suppose that Na = NJSfy and each a plane has a single lattice point 
{xa,ya) with non-zero probability. Furthermore, suppose that the point with non- 
zero probability is different for each a plane (i.e., {xai,yai) 7^ (2^02 52/02) ^1 ^2-) 
See Fig.(|I]a) for an example with A^^, = Ny = 2. Let a{x,y) be a 1-1 onto function 
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which maps Sxy — * Sa and (xq, ya) a. Define P(-) by 

P{x, y, a) = P{x, y)S{a, a{x, y)) = P{xa, Xa)6{y, ya) ■ (5) 

It is easy to check that P(-) is an element of pd(S'^y„) that satisfies Eqs. (0) and (|^). 

(6) Suppose that = Ny and at each a plane all lattice points have zero 
probability except for possibly those in a line of lattice points = {{x, ya)\x G S^}. 
Furthermore, suppose La^ ^ La^ iff 7^ 0^2 • See Fig.(|l|b) for an example with 
Nx = Ny = 2. Let a{y) be a 1-1 onto function which maps 5*^, Sa and ya —>■ ol. 
Define P(-) by 

P(x, y, a) = P{x, y)S{a, a{y)) = P{x, ya)5{y, ya) ■ (6) 
It is easy to check that this P(-) is an element of pd(S'^ya) that satisfies Eqs. (Q) and 

Note that even though every y) G pd(S'^j;) is separable, it may not be 
iV-separable. Example (6) above implies that y) is Na separable when A^^^ > 
minlNxjNy), but what if A'^ is smaller than this? (for example, if Na = 2 but 

Nx,Ny >> 2). For small enough Na, it may be impossible to construct a P{x,y,a) 
that satisfies all the constraints given by Eqs. @ and @. 
For P{x, y) G pd^S^y) and any integer > 1, define 

E^p\P) = -mmH{x : y\a) , (7) 
2 p - 

where the minimum is taken over the set of all P{x, y, a) G pd{Sxya) such that 
Na = N and P{x, y) = J2a Pi^i Hi cn)- The conditional mutual entropy H{x : y\a) is 
calculated for the probability distribution P. 

Theorem 3.2 P{x,y) G pd{Sxy) is N -separable if and only if Ep^\P) = 0. 
proof: 

(^) Clear. 

(<^) There exists a P{x,y,a) G pd{Sxya) such that Na = N, P{x,y) = 
X]q- P(a;, a), and H{x : y\a) = 0. Because this conditional mutual entropy van- 
ishes, P{x,y\a) = P{x\a)P{y\a). Hence, P{x,y) is A^-separable. QED 

4 Quantum Separability 

We say p G dm(TCxy) is N -separable (ditto, separable) iff there exist a random variable 
/i with N^ = N (ditto, with arbitrary N^) and there exist P(/i) G pd(S'^), G 
dm(Hx) and G dm(7ij^) such that p can be "decomposed" thus: 
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P = Y.n^^)p'.p'y■ (8) 



y_ 



An equivalent definition is: p G dTniTixy) is N -separable (ditto, separable) iff 
there exist a random variable a with N^, = N (ditto, with arbitrary N^) and there 
exist Wa G pd{Sa), lip^) G TCx and {i/jy) G Tij^ such that p can be "decomposed" thus: 

p = J2wM^lM^^)- (9) 

The second definition clearly implies the first. To see that the first definition 
implies the second: for each p, express and in terms of their eigenstates: 

p^ = En«l/^)IC)(CI' (10) 

a 

p(; = En^i/^)K)('/>fi- (11) 

We identify the index a with the 3-tuple {p, a, b) so Sa = 'S'^ofe- We define for all 
a G Sa'- 

Wa = P{a\p)P{b\p)P{p) , (12) 

m) = m (13) 

(note that the right hand side is the same for all b), and 

W = \<Pf) (14) 

(note that the right hand side is the same for all a). With these definitions, Eq.(|^) 
follows. 

In the previous section about classical separability, we encountered several 
theorems of the form: "P is separable iff condition X" . These theorems had matching 
theorems of the form "P is A^-separable iff = and condition X" . In what follows, 
we will often encounter theorems of the form: "p is separable iff condition X" . As in 
the classical case, these theorems about separability have obvious matching theorems 
about A-separability ("p is A^-separable iff A = A'„ and condition X"), but for 
simplicity, we will not mention them henceforth. 

Consider some Hilbert space H and some p G dm(?-^). p can be expressed as 

p = EA,|0^')(0^|, (15) 
j 

where (Aj, {(jt')) for all j are the eigenvalues and eigenvectors of p. In Ref.0, Hugh- 
ston, Jozsa and Wootters (HJW) proved the following theorem. 
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Theorem 4.1 (HJW) p G dm(7i) can he expressed as 



p = Y.wM-){r\ , (16) 

a 

where Wa G pd{Sa), and I?/;") G Ti. for all a if and only if there exists a transformation 
T" fa G Sa, j G {1,2,..., dim{7i)}) which is "right unitary" : 



and which satisfies 



proof: 

(<^=) Multiply each side of Eq.(|18D by its complex conjugate and sum over a. 
(=^) Using Eqs.(|T3p and (|IB|) and the fact that the eigenvectors \(j>') are or- 
thonormal, we get: 



a 

For those j such that Aj 7^ 0, define T by 



T-=J^{^^r)- (20) 

V 

One can represent T"' as a matrix with rows labelled by j G {1, 2, . . . , dim{T-C)} and 
columns labelled by a G Sa- Eg . (pOD defines only those rows of T with index j 
such that Aj 7^ 0. Eq.(|l9|) tells us that those rows which are defined by Eq. (pO|) 
are orthonormal. The remaining rows of T can be filled in using the Gram-Schmidt 
process |^ . Once T is fully specified, all the rows of T are orthonormal, and therefore 
Eq.(|l7D follows. It is easy to check that the T we have constructed also satisfies 
Eq.(|T§. QED 

The HJW Theorem refers to density matrices p in an arbitrary Hilbert space 
H. But what if ?i is a tensor product of two Hilbert spaces Hx and TCy7 Refs.[@ 
and apply the HJW Theorem to tensor product spaces. They prove the following 
theorem. 

Consider a p G dm(7i^y) with eigenvalues Xj and corresponding eigenvectors 
l^-' ) for all j G Nxy. Let 

A = diag{Xi,X2,...,XNj ■ (21) 
For any matrix Mjj/ with G Sxy, define 
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{M)^p = Y,T^M^,,T^,\ (22) 



for all a, /3 G 5*0,. 



Theorem 4.2 p G dmiTixy) is separable if and only if there exists a matrix 
(a G Sa, j G Sxy) and a set of vectors {\'ip°') G TixyW ^ *%} which satisfy: 

\r) = m\^l). (23) 

where \ip'^) G Tix and G Tiy, 

= {A)aa , (24) 

p = J2w^\r){r\ = = (25) 

J2 TfTfr = 6f , (26) 

a 

j:Tr^,\<i^) = v^\r) . (27) 

proof: 

We postpone proving this theorem since its proof follows from the proof of the 
following theorem. QED 

The last theorem is a very powerful tool because it parametrizes with a linear 
transformation T the space one must search to find a decomposition of a separable 
state p. Besides the constraint that T be right unitary, the theorem imposes no 
other constraints on the search space. In particular, it avoids imposing inequality 
constraints on the search space which other methods might impose in order to enforce 
the positivity of the eigenvalues of p, tt^i/j"), vr('0^). 

Although the last theorem is very powerful, it is somewhat distant from classi- 
cal considerations. One wonders whether one can find a set of necessary and sufficient 
conditions for quantum separability that more closely resemble the set of necessary 
and sufficient conditions for classical separability that we gave in Theorem Indeed 
one can, as the following theorem shows. 

Define the following array of operators: 



[K.y\j,f = ^JXm{cf>'WXf, (28) 

for j,j' G Sxy The matrix elements of K^y with respect to the \xy) basis will be 
denoted by: 

[Kxy;x'y']j,j' = [{xy\Kxy\x'y%j> = v^^iy^^Yv^ • (29) 
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We also define a partial trace of Kxy with respect to y: 

= ilyK^y , (30) 

whose matrix elements in the \x) basis are 

K,,, = {x\Kj,x') . (31) 

Analogously, Ky and Kyyi will stand for the partial trace of K^y with respect to x, 
and the matrix elements thereof. 

Theorem 4.3 p G dmiJ-Lxy) is separable if and only if there exists a transformation 
T!j^ (a & Sg_, j G Sxy) which is right unitary: 

J2 T^^Tf = Sf , (32) 

a 

and satisfies 

for all X, x' G Sx, y, y' G Sy and a G S^- 
proof: 

(^) Since p is separable, there exits Wa G pd(S'Q), and for each a G Sa, there 
exist states |^°) G Hx, li^y) G Hy so that 

p = J2wM^I_M^'^). (34) 

a 

p can also be expanded in terms of its eigenvalues and eigenvectors: 

P = Y.>^^<P')(<P'\- (35) 

j 

Equating these two expressions for p and taking matrix elements in the eigenvector 
basis gives: 



y: ^.{<t>>\^:ry){rxryW )v^= ■ m 

a 

For those j such that Aj 7^ 0, define T by 



= J^mrxry) ■ m 

V 

One can represent T°' as a matrix with rows labelled by j G Sxy and columns labelled 
by a G Sa. Eg . (1371) defines only those rows of T with index j such that Xj 7^ 0. Eq.(^) 



tells us that the rows defined by Eq. (^7]) are orthonormal. The remaining rows of T 
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can be filled in using the Gram-Schmidt process 0. Once T is fully specified, all 
the rows of T are orthonormal, so it is right unitary. Plugging the T matrix just 
constructed into the definition Eq.(p9D for {Kxy-x'y')aa yields 

{K^y;a:'y')aa = W ^iIj^ ^^^^ . (38a) 

Thus 



y 

{Ky,y>)aa = ^{K^y.^y,)aa = Watpy^Jy* , (38c) 

X 

{A)aa = ^{K:^y.^y)aa = Wa ■ (38d) 

x,y 

Eg s .([381) clearly imply Eg . (^3]) . 

(<^) Summing Eg.(p9D for {Kxy,x'y')aa over a and using the right unitarity of 
T yields 

= ^^t^iy^t^x' y' = {xy\p\x'y') . (39) 
° j 

We define Wa for all a by 

Wa = {A)aa ■ (40) 

Using the last two equations, we get 

{xy\p\xy') = J2{Kxy;x'y')aa = I] w^a(a;|p||x')(z/|p^|l/') , (41) 

a a 

where, for all a such that Wa 7^ 0, and are defined by 

= ^^^^ , (ylp'^W) = ^-^^^ . (42) 

Clearly, e dm{n^) and p° G dm(7^^). QED 

In the section on classical separability, we plotted P{x, y, a) at each point 
(x, y, a) e Sxya of a 3-dimensional orthogonal lattice with axes x, y, a. We noted that 

for a separable P(x, ?/), its P{x, y, a) is a product-corrugated surface on each a plane. 
Theorems [4.2| and on quantum separability show that similar plots are possible in 
the quantum case. One can plot the phase and magnitude of i/j^y. For a separable p, 
ip"y = ip^ipy, so both the phase and magnitude of ip^y are corrugated surfaces on each 
a plane. The magnitude is product corrugated and the phase is mod-27r addition 
corrugated. Note that J2x,y li^xyl"^ = 1, so \ip"y\'^ summed over all points of any a 
plane gives one. Note also that A°y = y/w^ifj^y satisfies J2x,y,a l^xyl"^ = 1, so \A'^y\'^ 
summed over all lattice points is one. 
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Theorem 4.4 Suppose p G dm(TCxy) can be expanded thus: 

P = Y: w^p'^ , (43) 

a 

where Wa G pd{Sa), and p" G dmiHxy) for all a G Sa- Furthermore, suppose 
{I a) I a G Sa} is an orthonormal basis ofTia and that a G Tixya is defined by 

a = ^Wo\a){a\p"' . (44) 

a 

(Note that p = tiacr). Then 

Saix : y\a) = J2 WaSpc. {x:y). (45) 

a 

proof: 

By definition, 

S<t{x : y\a) = S„{x,a) + S^{y,a) - S„{x,y,a) - S^{a) . (46) 

Each of the terms on the right hand side can be broken into two parts. Consider for 
example the So-{x,a) term: 



Scr{x,a) = 
= -tr2;,^[try(cr) logtr^(cr)] = 

= trx[tTy{WaP°') hgtTy{WaP°')] = 

a 

= H{w) + ^^WaSpa(x) , (47a) 

a 

where H{w) is the classical entropy for the probability distribution {zfola G Sa}- 
Likewise, one can show that 

S,{y, a) = H{w) + ^ WaSp. (y) , (47b) 

a 

Sa{x, y, a) = H{w) + J2 WaSp'^ {x, y) , (47c) 

a 

Sa{a) = H{w) . (47d) 

Plugging Eqs. (|47|) into the right hand side of Eq.(H) establishes Eg . (^5]) . QED 

See Ref . to learn how to build quantum Bayesian nets which yield a density 

matrix like the a (see Eg. (^4]) ) in the last theorem. 

Suppose p G dm(7Y) can be expressed as p = Y.a'^a\i^^){'^"'\i where Wa G 

pd(S'a) and |'?/'") G Ti for all a. Then we say the set £ = {(wq, |'0"))|q; G Sg} 
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is a p ensemble. In particular, the set of pairs of eigenvalues and corresponding 
eigenvectors of p constitutes a p ensemble which we will denote by Sq and call the 
standard p ensemble. Eg. (p^Sf) of the HJW Theorem can be represented schematically 
by T£o = £. 

For any p G dm{T-Cxy), the entanglement of formation is defined by 

EM = minJ2 w^S[tTy{\r){r\)] , (48) 

where the minimum is taken over the set of all p ensembles S = {{wa, |'0"))|q; G So}- 
But the HJW Theorem taught us that any p ensemble S can be parametrized by 
a right unitary matrix T such that TSq = S. Thus, we can also define Ep{p) as a 
minimum over all right unitary matrices with a & Sa and j G S^y Furthermore, 
if we define p° = 7r(V'") for all a, then S[tiy'n{ip'')\ = S~p^{x). Thus7Eq.(||) can be 
rewritten as 



Ef{p) = nun ^ WaSp^ (x) . (49) 

a 

But observe that pa is a pure state of dm{Hxy) so that Spa (x) = Sp^ (y) and Spa (x, y) = 
so Spa{x) = ^Spa{x : y). Using this observation. Eg . (^91) and Theorem we get 

^f(p) = ^ ^ w;„S'p<. (x : y) = ^ m^n 5<,(x : y\a) , (50) 

where a = Z^a 

Theorem 4.5 p G dm(7i^j^) separable if and only if Ep{p) = 0. 
proof: 

(^) If p is separable then p = J2a'^aP°', where p" = 7r(^/'°)7r('0^). Thus, 

J2a'>^aSpa{x ■.y)=0. 

(<^=) If Ef{p) = then there exist a right unitary matrix T and a p ensemble 
£ such that T^o = ^- If ^ = {{wa, |V^"))|a e S'J, then p = Ea^^p", p° = ^(V'") 
and S'pti(x : y) = for all a. Because its mutual entropy vanishes, p" = p"p^ where 
Px G dm(7i^) and p^ G dm(7ij^). Thus, p is separable. QED 



5 Similarities 



The previous two sections have discussed classical(C) and quantum(Q) separability. 
We end the paper by discussing the following table, which enumerates some of the 
similarities between the two cases: 
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Classical 


Quantum 


The unknown: 


P(x,y,a) 




Boundary conditions 
satisfied by the unknown: 


Y.aP{x,y,a) = P{x,y) 




Integral equations 
satisfied by the unknown: 


P{x, y, a) Y.x^,y^ Pixi,yi,a) = 
Eyi Pix,yi,a)J2^, Pixi,y,a) 


{Kxy-x'y')aa 'l2xi,yi {-^xiyi-xiyi) aa = 
X/yi {-^xyi;x'yi) aa X/ki {^xiy;xiy') aa 


Entropic eqn. equivalent 
to boundary value prob.: 


H{x : y\a) = 

for prob. dist. P{x,y,a) 


Sa{x : y\a) = 

for a = J2a'^a\a){a\p°' 



We proved a theorem that says that C separabihty of P{x, y) G pd{Sxy) imphes 
the existence of a certain "unknown" P{x,y,a) G pd{Sxya)- Likewise, we proved 
a theorem that says that Q separabihty of p G dm(?-^^j^) imphes the existence of 
a certain "unknown" T". In both the C and Q cases, the unknown must satisfy 
certain constraints which can be thought of as representing a boundary value problem 
comprising a set of discrete integral equations with boundary conditions. In both the 
C and Q cases, the existence of a solution to the boundary value problem was proven to 
be equivalent to the statement that a certain conditional mutual information vanishes. 
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